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Assessing  and  Controlling  the  Availability 
OE  Failure-Degraded  Service  Agents 


by 

D.  P.  Gaver  and  P.  A.  Jacobs 

EXECUTIVE  SUMMARY 

Military  items  such  as  airborne  surveillance  systems  (UAVs,  JSTARS,  helicopters, 
etc.)  or  combat  vehicles  (tanks,  APCs,  ships)  may  have  high  effectiveness  when  available 
on  station,  but  require  occasional  restoration  (refueling,  re-arming,  scheduled 
maintenance)  and  repair  after  unscheduled  failures  of  certain  subsystems.  This 
requirement  takes  them  off  station,  where  delays  occur  that  are  affected  by  the  numbers 
and  types  of  support  resources  and  the  philosophy  of  scheduling  those  resources. 

This  paper  considers  the  effect  of  decision  choices  on  long-run  item  availability  on 
station  when  items  can  be  in  several  levels  of  capability/effectiveness  when  on  station. 
The  model  is  used  to  show  that  a  simple  binary  decision  rule  (that  depends  on  ratios  of 
endurance,  failure,  and  restoration  and  repair  rates)  guides  the  decision  as  to  whether  a 
failed  item  should  be  completely  repaired  to  its  highest  level,  or  returned  to  duty  at  an 
incompletely-capable  state. 

View  this  as  an  indicator  of  the  types  of  rules  anticipated  to  apply  in  realistic 
generality.  These  will  be  the  subject  of  additional  research. 
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1.  Introduction  and  Problem  Formulation 

In  a  variety  of  situations  several  individual  items  (agents)  coexist  and  perform 
operational  functions,  such  as  region  surveillance  or  actual  combat.  They  require 
occasional  support  (e.g.  if  vehicles,  or  military  “platforms”,  refueling  and  repair).  Time 
out  for  restoration  (refueling)  is  inevitable  and  unavoidable,  but  failure  of  a  unit’s 
functional  capability  or  operational  condition,  while  necessary,  need  not  be  complete:  a 
partially-failed  or  degraded  unit  can  profitably  remain  active  under  some  circumstances. 
Under  certain  circumstances,  to  be  described,  it  is  overall-effective  to  partially  repair  a 
completely  failed  item,  rather  than  expend  time  and  resources  for  repair  to  complete 
functionality.  A  unique  military  situation  is  that  in  which  an  item  has  been  subjected  to 
chemical  or  biological  attack,  and  must  be  decontaminated:  there  can  be  a  choice  between 
partial,  or  complete  decontamination',  see  Klutke  and  Novikov  (1996).  In  this  paper  we 
provide  initial  models  and  rules  for  the  control  of  all  such  systems. 

Examples  of  the  options  and  decision  choices  occur  extensively  in  the  military: 
depending  on  need  for  information,  it  may  well  be  more  effective  to  quickly  field 
partially  effective  sensor  (e.g.  UAV)  systems  than  to  wait  for  complete  repair.  The  same 
can  be  true  of  tactically  required  artillery  pieces,  tanks,  or  reconnaissance  or  attack 
aircraft;  the  choice  of  partial  or  total  decontamination  is  another  example,  mentioned 
above.  Other  examples  occur  when  prompt  assistance  is  needed  after  an  emergency. 


either  natural  (e.g.  earthquake  or  fire)  or  terrorist-caused.  Failures  may  now  be  injuries  to 
humans  or  infrastructure;  partial  “repair”  means  initial  diagnosis  and  stabilization  of  an 
injured  individual,  or  provision  of  temporary  alternative  communication  or  transportation 
service. 

The  situation  modeled  is  analogous  to  the  classical  repairman  problem  (see  Feller 
(1968))  but  is  more  general  -  and  realistic  -  in  that,  for  us,  the  classical  “machines”,  our 
agents,  can  fail  partially,  i.e.  to  one  of  several  intermediate  levels  of  productivity  and 
then,  having  finally  reached  the  restoration-repair  service  facility,  can  be  repaired  there  to 
chosen  levels.  This  control  feature  is,  in  principle,  accomplished  probabilistically  in  our 
models.  The  control  objective  is  to  maximize  the  expected  utility  of  the  system  of  agents, 
using  as  control  options  the  rate  of  demand  for  repair,  and  the  choice  of  repair  objective. 
The  utility  function  involved  is  a  linear  function  of  the  numbers  of  agents  available  in 
each  performance  category.  For  UAVs  this  can  be  expected  time  on  station,  weighted  for 
sensor  capability. 

Our  analysis  begins  by  proposing  a  quasi-stochastic  “expected  value”  or  deterministic 
model  for  a  system  of  agents  that  can  each  be  in  one  of  three  states  of  performance 
capability:  Good,  Medium,  and  Bad.  When  restoration  or  repair  is  required  the  agent 
progresses  to  a  central  homebase  server  at  which  accumulated  and  queued  restoration  and 
repair  tasks  are  processed  in  a  weighted  processor-sharing  manner  (this  is  unrealistic  in 
detail,  but  is  anal5^ically  tractable;  it  will  be  useful  for  guiding  more  detailed 
simulations).  Control  is  accomplished  by  choice  of  the  weighting  probabilities.  This 
model  accounts  for  restoration-repair  facility  saturability  by  using  an  approximation 
described  in  Filipiak  (1988).  The  deterministic  model  is  especially  convenient  for 
exploring  time-dependent  or  ttansient  system  behavior. 

Next,  a  Markov  stochastic  network  version  of  the  above  model  is  constructed  using 
the  techniques  of  Kelly  (1979).  The  implications  of  the  two  model  types  are  compared 
numerically  and  seen  to  be  in  useful  agreement  for  the  utility  function  adopted. 
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Our  work  is  related  to  policies  for  minimal  repair;  cf.  Brown  and  Proschan  (1983), 
Phelps  (1983),  Chen  and  Feldman  (1997),  Kijima,  Morimura,  and  Suzuki  (1988)  and 
Righter  (1997).  Also  relevant  are  analytical  models  of  sortie  generation,  Hackman  and 
Dietz  (1997)  that  address  more  complex  setups  in  a  steady- state  context. 

2.  A  Pseudo-Stochastic  Deterministic  Expected- Value  Model 

The  system  will  be  described  in  terms  of  the  following  state  variables.  For  the  present 
model  these  are  real-valued  and  positive  functions  of  time;  in  the  subsequent  stochastic 
model  they  are  state  variables  of  a  multivariate  Markov  process  in  continuous  time. 

Let 

Uaif)  =  number  of  agents  in  Good  condition  and  Up  (productively  available)  at  time  t\ 

U^it)  =  number  of  agents  having  experienced  a  degrading  failure  and  Up  at  time  t; 

such  agents  are  said  to  be  in  Medium  condition; 

Doait)  =  number  of  agents  that  have  experienced  a  mission-affecting  failure  (MAF) 

while  in  Good  condition  and  that  are  Down  for  repair  at  time  t\  such  an  agent 
is  totally  unproductive  and  is  said  to  be  in  Bad  condition;  it  will  be  repaired  to 
the  Good  state; 

Dmb(0  =  number  of  agents  that  are  Down  at  time  t  because  of  a  mission  affecting 
failure  from  the  Up  Medium  state; 

a  decision  opportunity:  a  fraction  aua  are  sent  for  further  repair  to  Good, 

1  -  auG  are  released  to  Up  Medium  state; 

DcRit)  =  number  of  agents  in  Good  condition  that  are  Down  for  restoration  (refueling 
etc.);  they  will  be  restored  to  the  Good  state; 

Dmuit)  =  number  of  agents  in  Medium  condition  that  are  Down  for  restoration  to  the 
Medium  state  at  time  t\ 

a  decision  opportunity:  a  fraction  aMR  are  sent  for  further  repair  to  Good, 

1  -  (Xmr  are  released  to  Up  Medium  state; 

Dmg(0  =  number  of  agents  Down  in  Medium  condition  after  minimal  repair,  waiting  for 
repair  to  the  Good  state  at  time  t. 
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Parameters: 


N  =  Total  number  of  agents  (e.g.  mobile  sensors) 

Xgm  =  rate  of  occurrence  of  a  degrading  failure  for  a  Good  Up  system 

Xgb  =  rate  of  occurrence  of  a  total  failure  for  an  agent  (e.g.  a  sensor)  in  Good 

condition 

XuB  =  rate  of  occurrence  of  a  total  failure  for  an  agent  in  Medium  Up  condition 

l/fiG  =  mean  endurance  time  for  an  agent  in  Good  condition 

Usm  =  mean  endurance  time  for  an  agent  in  Medium  Up  condition 

=  mean  restoration  time  for  an  agent  in  Good  Down  condition 

llfiriM)  =  minimal  mean  restoration  time  of  an  agent  in  Medium  Down  condition;  agent 
will  remain  in  Medium  condition 

MlimiB)  =  minimal  mean  time  to  repair  an  agent  that  has  experienced  a  fatal  failure;  an 
agent  in  Medium  condition  will  still  be  in  Medium  condition  after  this  failure 

=  mean  time  to  repair  an  agent  for  a  degrading  failure 

aRG  =  fraction  of  service  effort  applied  to  repair  a  restored  Medium  Down  agent  to 
Good 

aMO  =  fraction  of  service  effort  applied  to  repair  a  Medium  Down  agent  that  had  a 
fatal  failure  while  it  was  in  Good  condition 

Although  the  above  are  constants  in  the  developments  that  follow,  they  can  be 
replaced  by  nearly  arbitrary  functions  of  time,  or  even  state,  especially  in  the  quasi¬ 
stochastic  deterministic  model.  The  differential  equations  arising  in  that  formulation  can 
be  numerically  solved,  e.g,  using  MATLAB.  This  paper  is  devoted  to  the  steady- state 
situation,  for  which  analytical  solutions  are  available,  and  which  permit  derivation  of 
(almost)  optimal  control  strategies.  But  transient  and  also  time-dependent  solutions  are 
often  important  and  can  be  obtained  more  easily  with  the  present  approach  than  using 
other  analytical  tools  of  which  we  are  aware. 

Let  S{f)-DGR{t)+Dm{t)+DGB{t)+DMB{t)+DMG{t),  the  number  of  agents  down  at  time  t. 
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Let  H{x)  be  a  differentiable  non- increasing  function  of  v,  it  will  represent  the  amount 
of  service  effort  when  there  are  x  agents  waiting  for  or  being  served.  See  Filipiak  (1988). 
An  example  is 

H{x)  =  -^  (2.1) 

1  -t- 

where  Cs  is  a  suitable  constant  (unity  in  what  follows). 

Time-Dependent  Equations 

Failure  or  Restoration  demand  from  Good  state  ^  \ 

(2.2a) 

Service  to  Good  state 


Ul  ' - V - '  ' - - ' 

Partial  Failure,  Failure  to  Bad  or 

Good  to  Medium  Restoration  demand  from  Medium 


(2.2b) 


{S (t ))[flr  {M)(l  -aj^Q  +  (^)(l  ~<^MG  )^MB  )] 

' - V - ' 

Restoration  or  Repair  to  Medium 

eaUc{t)  -H{S{t))jlr{G)Dc.n{t)  (2.2c) 

at  — , - '  ' - , - ' 

Good  Restoration  Restoration 

demand  completion  to  Good 

euU„(t)  -H(S(t))tlr{M)Dm{t)  (2.2d) 

at  ' — — '  ' - - ' 

Medium  Restoration  completion 

Restoration  demand  to  Medium 

=  (2.26) 

dt  ^  ^  V  V.  ■■,.1.1,,^  .  .  —  / 

Medium  fails  Repair  of  Medium,  failed  to  Bad, 
to  Bad  to  Medium 

- ^ {^{^))[l^r{^)otRGDMR  W  +  l^m{B)cCMGDMB (O] ~H{S{t))ll^ {M)Dmg (0 (2-2f) 

at  ' - V- - '  ' - V - ' 

Number  continuing  from  beyond  minimum  repair:  Repair  to  Good  completion 

Medium-repaired  to  Good  repair  state 
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g(a;  p,N)  =  Uoia,  AO  +  /?  UMia,  M) 

where  we  let  ana  =  ocmg  =  ct,  the  probability  that  an  agent  that  has  been  Down  and  has 
been  restored/repaired  to  Medium  level  is  allocated  further  repair  to  the  Good  state,  with 
0<j3<l.  This  notation  makes  explicit  the  degradation  of  capability  associated  with 
being  in  the  Medium  rather  than  Good  state,  and  also  the  control  inherent  in  the 
probability  a;  finally,  the  influence  of  the  agent  population  size,  N,  is  expressed. 

Given  values  for  p  and  N  in  addition  to  other  rate  parameters,  the  utihty  function  g 
can  be  numerically  studied/optimized  on  a.  Considerable  numerical  exploration,  using 
random  selections  of  system  parameters  in  a  manner  analogous  to  that  suggested  by 
Miller  (1997),  leads  to  the  empirical  conclusion  that  random  strategies  (0  <  a  <  1)  are 


6 


rarely  optimal,  and,  when  they  do  occur  are  only  slightly  better  than  pure  strategies 


(a  =  0,  or  ct  =  1).  In  fact,  consideration  of  the  case  N  large  clarifies  the  situation  and  leads 

to  the  nearly- optimal  control  policy  as  follows: 

Let 

£m  I  ^mb 

(2.8) 

j  ^GM  j  ^GB 

^r{G)  I^JM) 

(2.9) 

y  ^MB 

^GM 

(2.10) 

Then  K=ya  and  c  =  a  +  bya,  the  parameters  in  the  solution  U. 


When  N  becomes  large, 

Optimum  a  =  1 

if  )0<  a/5; 

Optimum  a:  =  0 

if  /?  >  ajb . 

To  show  this,  let  >  oo  in  expression  (2.5)  for  U  to  obtain 


so,  by  (2.3)  -  (2.4) 


c^c  Cs{a  +  bya) 


f  n  \  ( l  +  K"^  K  p 

g(a;/3,oo)=  - 

CsC  j  (l+r)  (1  +  K-) 


Since 


ya  +  P 

Cs{bya  +  a) 


dg  ^  y{a-bp) 
doc  {bya  +  of 


(2.11) 


the  above  policy  is  verified. 
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Let  aG{D)  be  the  expected  amount  of  time  an  agent  spends  down  with  a  MAP  but  is  in 
otherwise  good  condition  before  it  is  reclassified;  let  auiD)  be  the  conditional  expected 
amount  of  time  an  agent  spends  down  in  Medium  condition  before  it  is  reclassified,  given 
it  spends  time  in  Medium  condition;  let  auRiD)  be  the  conditional  expected  amount  of 
time  a  Medium  condition  an  agent  spends  in  restoration  before  being  reclassified,  given  it 
spends  time  in  Medium  condition;  let  auMiP)  be  the  conditional  expected  amount  of  time 
an  agent  in  Medium  condition  spends  being  repaired  for  MAP  before  being  reclassified. 
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given  it  spends  time  in  Medium  condition;  let  a{D)  be  the  expecte4  amount  of  time  an 
agent  spends  in  Down  state  before  it  is  reclassified.  For  Q<aRG+aMG 

_ ^  I  ^MB  1 

£m+^MB  ^M+^MB 

— _ £fi _ ^  I _ _ ^  (3.6) 

^G+^GB'^^GM  ^G  +^GB+^GM 


a{D)  =  ac  (D)  +  — -  ^  ^ (D) 

^G'^^GB  '^^GM 


^mr{^)  - 


(^mb{^)- 


_ gM  Mr(^) _ 

,  ^MB 

— — ^ +;r“Ti  “mg 

^MB _ 1 

_ ^M+^MB  _ 

r~Tl - - “mg 

Sm+^MB  ^M+'^MB 


Theorem  (3.12)  of  Kelly  (1979)  implies  that  the  limiting  distribution  of  the  number  of 
agents  in  the  up  class  and  the  down  class  is 


.  .  a{Ur^  a{Dr 

^  rimin(^,.5') 


(3.10) 


where  K  is  a  normalizing  constant  and  s  is  the  number  of  servers  in  the  D  class.  The 
expected  number  of  agents  in  the  up  class  (respectively  down  class)  is 


E[U]  =  Ku 


=0  >^u'- 


(3.11) 


(respectively  E[D]  =  Kp 


”0=0  J|min(yt,5) 

k=i 


(3.12) 
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where  Ku  and  Kd  are  normalizing  constants.  The  expected  number  of  agents  in  the  up 
class  that  are  in  good  condition  (respectively  medium  condition)  is 

E[Ua]  =  HU]^^  (3.13) 

(respectively,  E[Uu]  =  £[(/]  ^ )  (3.14) 

The  expected  number  of  agents  in  the  down  class  that  are  being  repaired  for  an  MAP  but 
are  otherwise  in  good  condition  (respectively  are  in  medium  condition) 

(3-15) 

(respectively,  =  (3,16) 

a{D) 

Numerical  Examples 

Below  are  tables  comparing  the  numbers  of  agents  in  vaidous  categories  for  the 
deterministic  and  stochastic  models.  While  the  two  models  are  not  exactly  comparable, 
the  deterministic  model  yields  results  close  to  those  of  the  stochastic  model. 


Table  1 

^=4;  Aom=0.1;  Xgb-0.05;  Xmb=0.05;  £0=0.2;  £^=0.2;  ;U,„(M)=0.5;  //^(Gl^O.S;  /im(MG)-5; 
/ir(G)=10;  ^r(M)=10;  aRG=0.5;  aMG=0.5;  single  server;  Cs=l 


Expected  Number 


Category 

Deterministic 

Queuing 

Model 

Model 

Good:  Up 

1.81 

1.87 

Medium:  Up 

1.45 

1.50 

Good:  Catastrophic  Failure 

0.32 

0.27 

Medium:  Catastrophic  Failure 

0.25 

0.21 

Repair:  Medium  to  Good 

0.06 

0.05 

Good:  Restore 

0.06 

0.05 

Medium:  Restore 

0.05 

0.04 
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Table  2 

N=A\  Agm=1;  Agb=0.05;  Amb=0.1;  £0=0.2;  £^^=0.5;  /im(M)=0.5;  iimiG)=0.5;  /j„j(MG)=5; 
/ir(G)=10;  iir{M)=n\  ai?G=0.5;  aMG=0.5;  single  server;  Cj=l 


Expected  Number 


Category 

Deterministic 

Queuing 

Model 

Model 

Good:  Up 

0.52 

0.60 

Medium;  Up 

1.73 

2.00 

Good:  Catastrophic  Failure 

0.14 

0.11 

Medium:  Catastrophic  Failure 

0.95 

0.76 

Repair:  Medium  to  Good 

0.29 

0.23 

Good:  Restore 

0.03 

0.02 

Medium:  Restore 

0.34 

0.27 

4.  The  Repair  Policy  for  the  Stochastic  Model  with  A^=l 
Let 


E[U{a)] 


1 


-+ 


A 


CM 


1 


1 


'^GB+^G+'^GM  -^Gfi  +  £g  + -^CM  Ct  i^MB +£m 


(4.1) 


£[Z)(a)] 


_ ^ _ 1  ^ _ £g _ 1 

-^GB+fiG+AcM  ^GB+Sc+^CM  l^r{G) 


+ 


Agm 

1  1 

_j_ 

£m  1  1  A^g  1 

Acb  +  £c  +  Acm 

_^„(M)  a 

_Am6+£m  ?ImB+£m 

(4.2) 


1 


8{(x;P)  = 


^CB  +  Sc  +  ^ 


■  +  P 


^GM 


1  1 


CM 


Acs  +  £g  +  a  r,M  CX  X  mb  +  6 


CM  ^ 


£[G(a)  +  L»(a)] 


a  +  P 


^GM 


Acm  +  f  m 


a 


2  1  Acb  I  £c  1  Agm 

,  Acm 

1 - 

H 

to 

1 _ 

ldr{G) 

T" 

Amb  +  £m 

jl.iM)  fl4B)_ 

a  +  p- 


7 


Ctfl  +  H - Cl 

7 


(4.3) 
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Note  that 


dgia-,P) 

da 


{l  +  b)\ 


a 


l+b 


-P 


a\\  +  b'\+~a 

.  r  J 


Hence  the  repair  policy  is  as  follows. 


(4.4) 


The  Repair  Policy  for  Stochastic  Model  with  A^=l: 

If  P  <  —  —  then  the  maximizing  a  is  «=!;  always  repair  the  agent  in  Medium 
l  +  b 


condition  to  Good. 
a 


If  B> -  then  the  maximizing  a  is  a=0;  never  repair  the  agent  in  Medium 

l  +  b 


condition  to  Good. 
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APPENDIX  1 
Long-Run  Solutions 


Setting  the  derivatives  equal  to  zero  in  system  (2a)  -  (2g)  results  in  the  following 
equations 


0  -  -{^GM  +  -^05  +  £g 

+H{S\llr{G)DQf^+  jl^{M)DMG  +A^m(^)^G5] 

(Al-la) 

+H  )Dmr  +  (^)(l  MG  )DmB  ] 

(Al-lb) 

0  =  eaUG-H{S)i2,(G)DGR 

(Al-lc) 

0  =  Sm^M  ~ 

(Al-ld) 

0  =  ^mB^M  ~^iS)lJ.m(B)DMB 

(Al-le) 

0  =  H{S)[fJ.riM)a  rqDmr  +  iJ,^{B)a  i^^gD^r]  -  H{S)iim{M)DMG 

(Al-lf) 

0  =  XgbUg-H{S)iuJb)Dgb 

(Al-lg) 

These  must  be  solved  subject  to  the  condition  that  all  state  values  sum  to  N.  Equations 

(Al-ld),  (Al-le),  and  (Al-lg)  result  in 

p,  _  ^MB^M 

H{S)njB) 

(Al-2) 

_ 

HiS)nAM) 

(Al-3) 

n  _  ^GB^G 

(Al-4) 
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Substitution  of  (Al-3)  and  (Al-2)  into  equation  (Al-lb)  results  in 


Thus 


0  - 

+\{1-ccrg)Sm^m'^{}-~^mg)^mb^m\ 


(Al-5) 


Ug  - 


where 


a 

^GM 


(Al-6) 


(Al-7) 


if  ^GM  >  0. 

Substitution  of  (Al-S)  and  (Al-2)  into  equation  (Al-lf)  results  in 

0  =  £ RG^ M ^ MB^ MG^ M  ~  (Al-8f) 

Multiplying  equation  (Al-ld)  by  jir{G)l}Xr{M),  equation  (Al-le)  by  fJ.r(G)/jJ.m(,B),  equation 
(Al-8f)  by  iu.r(G)ljJ.miM)  and  equation  (Al-lg)  by  jir{G)ljA.m{B),  adding  the  resulting 
equations  and  using  (Al-6)  results  in 

cUm^H{S)S  (Al-9) 

where 

^G^  ,  £m  I  ^MB  I  I  ^GB^  (Al-10) 

II,  (G)  Aim  (5)  llmiM)  lIrrXB) 

Note  that 

S  =  N-{\  +  k)Um  (Al-11) 

Thus  (Al-9)  can  be  rewritten  as 

cUm  -^[N-{1  +  k)Um]H[N-{1  +  k)Um)  (Al-12) 

Putting  U=^Ug+Um=0-+k)Um  and  substituting  into  equation  (Al-12)  results  in 
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1  +  k: 


U  =  [N-U]H(N-U) 


(Al-13) 


Rewriting, 


U 


■  =  H{N-U) 


1  +  k[N-U] 

Equation  (Al-14)  has  one  solution  between  0  and  A. 

In  the  special  case  H(x)=l/(l+C!iX)  equation  (Al-14)  is  a  quadratic 

0  =  -  (1 +_^(1  +  rN))U  +  N 

l  +  K  1  +  k: 


(Al-14) 


U 


(l4—^(l  +  c,7V))-,  (1-t-^— (l-hc,iVr-4- 


XT 

J—N 
+  K 


2-  ^ 


(Al-15) 


(Al-16) 


l  +  K 


Finally 


and 


Um=U/(1+k) 


Ug 


K 


l+K 


■U. 
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If  b>a,  then  there  is  a  0  <  jSo  <^i  <  1  such  that  for  is  maximized  at  a=l 

(always  repair  a  Medium  agent  to  Good);  for  j3>pi  g{a\P)  is  maximized  at  a=0  (never 
repair  a  Medium  agent  to  Good). 


18 


Policy  11:  This  maximizes  the  long-run  total  number  of  agents  up 

If  b<a,  then  U(a)  is  maximized  at  a=l;  that  is  always  repair  an  agent  in  the  Medium 
condition  to  Good. 

If  b>a,  then  U(a)  is  maximized  at  a-0;  that  is  never  repair  an  agent  in  Medium 
condition  to  Good. 

Proof  for  Policy  11: 

Note  that  f{a)  = -  is  a  decreasing  function  of  a  if  b<a  and  is  a  nondecreasing 

1  +  K 

function  of  a  otherwise.  Since  H(x)  is  a  decreasing  function,  H{N-U)  is  an  increasing 
function  of  U.  Further,  (N-U)H(N-U)  is  a  decreasing  function  of  U.  If  b<a  so  that/(a) 
decreases  with  a,  then  equation  (Al-13)  implies  that  U(a)  increases  with  a.  If  b>a,  then 
f{a)  increases  with  a  and  U{a)  decreases  with  a.  Policy  I  follows. 

Proof  for  Policy  I: 

Note  that 


d  ,  \  7Cx  +  (5dU{a) 

da  l  +  ya  l  +  ya  da 

-  U(a)+. 


l  +  ya 

P 


l  +  ya 


-'}U{a)  + 


l  +  ya  da 
dU{a) 


da 


If  b<a,  then  and  -^g{a', ^)>0;  thus  the  maximizing  a  for  g{,a\B)  is  a=l. 

da  da 


If  b>a,  then  If  p=0,  then  y{a;0)=UG(a).  Recall  that 

da 


Uaia)  =  yaUinia). 


Thus, 


d 

—UG{a)=^yUM{cc)  +  ya 
da 


d 

da 


I/m  (a) 
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and 


■^U(a)  =  ■^Uoia)+-^Uu(cc) 
da  da  da 


d 


Hence, 


=^jUM{a)  +  [ya  +  l]—UMioc). 


-^U{a)-yUM{a) 

—Um{(x)  =  — - ^ - <0- 

da  ya  +  l 


The  value  of  a  which  minimizes  Um{oC}  is  a-l.  In  addition  -—Uj^{a)<——U(a).  Since 

da  da 

—U(a)  =  —UQ{a)  +—U;^(a)  it  follows  that  0  <-^U{a)--^U;^{a)  =  —UQ{a). 
da  da  da  da  da  da 


Thus,  the  maximizing  value  of  a  for  Ucioi)  is  «=!;  always  repak  agents  in  Medium 
condition  to  Good.  Thus, 


1  +  ya  1  +  ya  da 

j 

Recall  from  Policy  II  that  if  5=1  then  — ^(a;l)<0  and  the  maximizing  a  is  a=0  (never 

da 

repair  a  Medium  agent  to  Good  condition).  Policy  I  follows. 


20 


INITIAL  DISTRIBUTION  LIST 


1.  Research  Office  (Code  09) . . . . . . 1 

Naval  Postgraduate  School 

Monterey,  CA  93943-5000 

2.  Dudley  Knox  Library  (Code  013) . 2 

Naval  Postgraduate  School 

Monterey,  CA  93943-5002 

3.  Defense  Technical  Information  Center . 2 

8725  John  J.  Kingman  Rd.,  STE  0944 

Ft.  Belvoir,  VA  22060-6218 

4.  Therese  Bilodeau  (Editorial  Assistant) . . . 1 

Dept  of  Operations  Research 

Naval  Postgraduate  School 
Monterey,  CA  93943-5000 

5.  Prof.  Donald  P.  Gaver  (Code  OR/Gv) . 3 

Dept  of  Operations  Research 

Naval  Postgraduate  School 
Monterey,  CA  93943-5000 

6.  Prof.  Patricia  A.  Jacobs  (Code  OR/Jc) . 3 

Dept  of  Operations  Research 

Naval  Postgraduate  School 
Monterey,  CA  93943-5000 

7.  Professor  Gordon  Schacher . . . 1 

Director,  Institute  for  Joint  Warfare  Analysis 

Dept,  of  Physics 
Naval  Postgraduate  School 
Monterey,  CA  93943 

8.  Dr.  Michael  P.  Bailey . 1 

Principal  Analyst,  Modeling  &  Simulation 

MCCDC 

3300  Russell  Road 
Quantico,  VA  22134-5130 

9.  Prof.  D.  R.  Barr . 1 

Dept,  of  Systems  Engineering 

U.S.  Military  Academy 
West  Point,  NY  10996 


21 


1 


10.  Prof.  H.  Chemoff . 

Department  of  Statistics 
Harvard  University 
1  Oxford  Street 
Cambridge,  MA  02138 


11.  Dr.  Paul  K.  Davis . 1 

RAND  Corporation 

1700  Main  St. 

Santa  Monica,  CA  90406 

12.  Dr.  Arthur  Fries . 1 

Institute  for  Defense  Analysis 

1800  North  Beauregard 
Alexandria,  V A  22311 

13.  Dr.  NeilGerr . 1 

Office  of  Naval  Research 

Arlington,  VA  22217 

14.  Dr.  Moshe  Kress . 1 

CEMA 

P.O.B.  2250  (TI) 

Haifa  31021 
ISRAEL 


15.  Prof.  J.  Lehoczky . 1 

Department  of  Statistics 

Carnegie- Mellon  University 
Pittsburgh,  PA  15213 

16.  COL  R.S.  Miller . 1 


Institute  for  Defense  Analysis 
1800  North  Beauregard 
Alexandria,  V A  22311 

17.  Dr.  Kenneth  Pendergast . 1 

Institute  for  Defense  Analysis 

1800  N.  Beairregard 
Alexandria,  V A  22311 

18.  Dr.  Rhonda  Righter . .  1 

Dept,  of  Decision  &  Info.  Sciences 

Santa  Clara  University 
S  anta  Clara,  CA  95118 


22 


19.  Dr.  Ernest  Seglie . 

Science  Director,  DOT&E 

3E318  Pentagon 
Washington,  DC  20301-1700 

20.  Dr.  William  Stevens . 

Metron 

512  Via  de  la  Valle 
Suite  301 

Solana  Beach,  CA  92075 

21.  Dr.  Gideon  Weiss . 

Dept,  of  Statistics 

The  University  of  Haifa 
Haifa  31905 
ISRAEL 

22.  Dr.  Howard  L.  Wiener . 

SEW  Strategic  Planning  Office,  N6C5 
2000  Navy  Pentagon,  Rm  5C633 
Washington,  DC  20350-2000 


23 


